Below is a summary of what we found when checking the rsid report suite looking at data from start_date to end_date
Note: The raw data for everything that follows is available in [this Google Sheet].
This is an R Markdown document. Markdown is a simple formatting syntax for authoring HTML, PDF, and MS Word documents. For more details on using R Markdown see http://rmarkdown.rstudio.com.
pre/post date ranges & cut over period Days since website launch Example Graph with highlighted info
## A marker object has been specified, but markers is not in the mode
## Adding markers to the mode...
ggplotly(c1)
ggplotly(r1)
ggplotly(top10)
ggplotly(bot10)
ggplotly(highlow_count)
ggplotly(sl1)
ggplotly(sl2)
ggplotly(sl3)
The following are some highlights.
Top 10 Good Bad
Number of Journeys Higher or Lower than Baseline
Dumbbell plots Parallel Plot - Top 10 good/bad
Most common user journeys though the website
How are Entry journeys affected by the changes
Device journeys and any gaps
Journeys grouped by their category and measures
Below is a summary of the website journeys looking at data from 2021-09-02 to 2022-02-28. This table is sorted by the difference between the baseline and the new site baseline difference percentage. Higher performing new journeys should come to the top while worst performing journeys should be at the bottom.
| Journey Name | Baseline Visits | New Site Visits Avg. | % Visits Diff. |
|---|---|---|---|
| Members Area Entry | 1062 | 1703 | 60.4% |
| Holidays Entry | 2074 | 3235 | 56.0% |
| ALL Holidays | 9243 | 9529 | 3.1% |
| Commercial: Renew Checkout Steps 1-3 | 113 | 143 | 26.5% |
| Commercial: Membership Checkout Steps 1-4 | 1725 | 1911 | 10.8% |
| Commercial: Holidays Checkout Steps 1-4 | 261 | 288 | 10.3% |
| Commercial: Shop Checkout Steps 1-4 | 461 | 416 | -9.8% |
| Shop Entry | 4849 | 4379 | -9.7% |
| Join Us Entry | 11387 | 10357 | -9.0% |
| Home to Holidays | 901 | 832 | -7.7% |
| Home to Join | 2561 | 2366 | -7.6% |
| Days Out to Property Page | 4298 | 2912 | -32.2% |
| Home to Search Results | 4569 | 3156 | -30.9% |
| ALL Tablet | 11538 | 8317 | -27.9% |
| Home to Days Out | 5946 | 4306 | -27.6% |
| Homepage Entry | 19355 | 14290 | -26.2% |
| ALL Direct Traffic | 20749 | 16116 | -22.3% |
| ALL Repeat Visitors | 76044 | 59416 | -21.9% |
| ALL Paid Social | 2816 | 2220 | -21.2% |
| Home to Our Cause | 520 | 411 | -21.0% |
| Property Page Seen | 100862 | 80125 | -20.6% |
| ALL Android | 45701 | 36432 | -20.3% |
| Commercial: Donate Checkout Steps 1-2 | 441 | 355 | -19.5% |
| Days Out Entry | 1972 | 1588 | -19.5% |
| ALL Desktop | 43086 | 34784 | -19.3% |
| ALL Main Site | 145069 | 117166 | -19.2% |
| Days Out to Places Search | 10670 | 8626 | -19.2% |
| ALL Visits | 156930 | 128380 | -18.2% |
| Days Out to Places Map | 3987 | 3270 | -18.0% |
| Home to Support | 305 | 250 | -18.0% |
| ALL Natural Search | 101694 | 83815 | -17.6% |
| ALL Shop | 7646 | 6298 | -17.6% |
| ALL Mobile | 102279 | 85257 | -16.6% |
| Home to Art | 235 | 196 | -16.6% |
| ALL SEO | 100329 | 83913 | -16.4% |
| ALL Apple iOS | 68077 | 57078 | -16.2% |
| ALL Email | 9783 | 8251 | -15.7% |
| ALL PPC | 14935 | 12713 | -14.9% |
| ALL Social | 1851 | 1576 | -14.9% |
| ALL New Visitors | 80886 | 68964 | -14.7% |
| ALL Affiliates | 1407 | 1218 | -13.4% |
| Home to Shop | 1592 | 1395 | -12.4% |
| Home to Donate Form | 127 | 112 | -11.8% |
Below is the detail behind each journey and main traffic metrics for each journey.
| Journey Name | Journey Type | Visits Avg. | Page Views Avg. | UV Avg. | Bounces Avg. | Avg. Time on Site | Avg. % New Visits | Avg. % Repeat Visits | Avg New Visits | Avg. Repeat Visits |
|---|---|---|---|---|---|---|---|---|---|---|
| ALL Affiliates | pre | 1407 | 5936 | 1261 | 407 | 357 | 54.6% | 45.3% | 777 | 630 |
| ALL Affiliates | post | 1218 | 5552 | 1079 | 342 | 381 | 56.6% | 43.4% | 688 | 530 |
| ALL Android | pre | 45701 | 141262 | 39899 | 18321 | 282 | 44.2% | 55.8% | 20094 | 25607 |
| ALL Android | post | 36432 | 114836 | 31951 | 14890 | 276 | 49.2% | 50.8% | 17859 | 18573 |
| ALL Apple iOS | pre | 68077 | 203454 | 57802 | 28647 | 271 | 64.6% | 35.4% | 43936 | 24141 |
| ALL Apple iOS | post | 57078 | 174055 | 48017 | 24581 | 272 | 65.9% | 34.1% | 37512 | 19566 |
| ALL Desktop | pre | 43086 | 189468 | 38464 | 14066 | 379 | 56.4% | 43.6% | 24234 | 18849 |
| ALL Desktop | post | 34784 | 154374 | 31113 | 11595 | 373 | 60.0% | 40.0% | 20848 | 13934 |
| ALL Direct Traffic | pre | 20749 | 64257 | 18156 | 8385 | 271 | 64.6% | 35.4% | 13451 | 7295 |
| ALL Direct Traffic | post | 16116 | 52248 | 13981 | 6529 | 270 | 66.3% | 33.7% | 10697 | 5418 |
| ALL Email | pre | 9783 | 33493 | 8784 | 4031 | 304 | 41.2% | 58.8% | 4752 | 5030 |
| ALL Email | post | 8251 | 30048 | 7340 | 2984 | 316 | 41.3% | 58.6% | 4216 | 4035 |
| ALL Holidays | pre | 9243 | 37089 | 8308 | 2808 | 374 | 55.7% | 44.3% | 5160 | 4084 |
| ALL Holidays | post | 9529 | 41681 | 8482 | 2798 | 390 | 58.5% | 41.5% | 5603 | 3927 |
| ALL Main Site | pre | 145069 | 451336 | 126142 | 56357 | 286 | 56.6% | 43.4% | 81857 | 63218 |
| ALL Main Site | post | 117166 | 366786 | 101659 | 46883 | 279 | 59.7% | 40.3% | 69851 | 47319 |
| ALL Mobile | pre | 102279 | 299814 | 87456 | 42968 | 263 | 56.8% | 43.2% | 57940 | 44339 |
| ALL Mobile | post | 85257 | 256555 | 72553 | 36525 | 264 | 59.5% | 40.5% | 50543 | 34714 |
| ALL Natural Search | pre | 101694 | 352795 | 88109 | 37016 | 320 | 54.0% | 46.0% | 54657 | 47040 |
| ALL Natural Search | post | 83815 | 286349 | 72592 | 32733 | 314 | 57.8% | 42.2% | 48362 | 35454 |
| ALL New Visitors | pre | 80886 | 276867 | 80886 | 29077 | 272 | 99.9% | 0.1% | 80798 | 81 |
| ALL New Visitors | post | 68964 | 242573 | 68964 | 24802 | 271 | 99.9% | 0.1% | 68896 | 62 |
| ALL Paid Social | pre | 2816 | 5833 | 2720 | 1703 | 189 | 70.6% | 29.4% | 1996 | 820 |
| ALL Paid Social | post | 2220 | 4790 | 2152 | 1274 | 193 | 73.8% | 26.2% | 1658 | 562 |
| ALL PPC | pre | 14935 | 70563 | 13503 | 5438 | 401 | 62.4% | 37.6% | 9329 | 5607 |
| ALL PPC | post | 12713 | 65665 | 11350 | 4104 | 416 | 62.9% | 37.1% | 8011 | 4702 |
| ALL Repeat Visitors | pre | 76044 | 257467 | 63507 | 31989 | 348 | 10.0% | 90.0% | 7517 | 68531 |
| ALL Repeat Visitors | post | 59416 | 200896 | 49448 | 26307 | 348 | 12.5% | 87.5% | 7395 | 52024 |
| ALL SEO | pre | 100329 | 366825 | 91722 | 34012 | 317 | 62.2% | 37.8% | 62208 | 38124 |
| ALL SEO | post | 83913 | 307127 | 76675 | 29992 | 311 | 65.9% | 34.1% | 55183 | 28730 |
| ALL Shop | pre | 7646 | 45453 | 6930 | 1851 | 315 | 55.1% | 44.9% | 4232 | 3414 |
| ALL Shop | post | 6298 | 34648 | 5705 | 1395 | 274 | 58.8% | 41.3% | 3693 | 2606 |
| ALL Social | pre | 1851 | 3967 | 1772 | 964 | 179 | 79.8% | 20.2% | 1482 | 369 |
| ALL Social | post | 1576 | 3584 | 1512 | 798 | 169 | 80.9% | 19.1% | 1281 | 295 |
| ALL Tablet | pre | 11538 | 44971 | 10285 | 4020 | 369 | 53.3% | 46.7% | 6122 | 5416 |
| ALL Tablet | post | 8317 | 32469 | 7479 | 2980 | 355 | 58.6% | 41.4% | 4885 | 3431 |
| ALL Visits | pre | 156930 | 534334 | 136188 | 61066 | 307 | 56.4% | 43.6% | 88315 | 68612 |
| ALL Visits | post | 128380 | 443469 | 111126 | 51109 | 304 | 59.5% | 40.5% | 76291 | 52086 |
| Commercial: Donate Checkout Steps 1-2 | pre | 441 | 2165 | 375 | NA | NA | NA | NA | NA | NA |
| Commercial: Donate Checkout Steps 1-2 | post | 355 | 1762 | 296 | NA | NA | NA | NA | NA | NA |
| Commercial: Holidays Checkout Steps 1-4 | pre | 261 | 2380 | 182 | NA | NA | NA | NA | NA | NA |
| Commercial: Holidays Checkout Steps 1-4 | post | 288 | 2762 | 195 | NA | NA | NA | NA | NA | NA |
| Commercial: Membership Checkout Steps 1-4 | pre | 1725 | 14275 | 1286 | NA | NA | NA | NA | NA | NA |
| Commercial: Membership Checkout Steps 1-4 | post | 1911 | 16296 | 1425 | NA | NA | NA | NA | NA | NA |
| Commercial: Renew Checkout Steps 1-3 | pre | 113 | 689 | 98 | NA | NA | NA | NA | NA | NA |
| Commercial: Renew Checkout Steps 1-3 | post | 143 | 895 | 123 | NA | NA | NA | NA | NA | NA |
| Commercial: Shop Checkout Steps 1-4 | pre | 461 | 6680 | 348 | NA | NA | NA | NA | NA | NA |
| Commercial: Shop Checkout Steps 1-4 | post | 416 | 5670 | 315 | NA | NA | NA | NA | NA | NA |
| Days Out Entry | pre | 1972 | 12241 | 1452 | 456 | 481 | 24.8% | 75.2% | 495 | 1477 |
| Days Out Entry | post | 1588 | 9780 | 1156 | 385 | 457 | 29.2% | 70.8% | 466 | 1122 |
| Days Out to Places Map | pre | 3987 | 28614 | 3078 | 846 | 502 | 29.0% | 71.0% | 1167 | 2820 |
| Days Out to Places Map | post | 3270 | 24087 | 2525 | 708 | 492 | 34.3% | 65.7% | 1118 | 2151 |
| Days Out to Places Search | pre | 10670 | 77447 | 8399 | 2181 | 485 | 31.8% | 68.2% | 3415 | 7256 |
| Days Out to Places Search | post | 8626 | 64099 | 6784 | 1807 | 475 | 36.9% | 63.1% | 3176 | 5450 |
| Days Out to Property Page | pre | 4298 | 28030 | 3428 | 803 | 464 | 30.5% | 69.5% | 1321 | 2977 |
| Days Out to Property Page | post | 2912 | 19178 | 2306 | 563 | 453 | 34.5% | 65.5% | 1001 | 1911 |
| Holidays Entry | pre | 2074 | 12549 | 1599 | 507 | 532 | 28.1% | 71.9% | 586 | 1489 |
| Holidays Entry | post | 3235 | 18929 | 2608 | 799 | 487 | 34.8% | 65.2% | 1179 | 2056 |
| Home to Art | pre | 235 | 1752 | 174 | 46 | 580 | 32.9% | 67.1% | 76 | 158 |
| Home to Art | post | 196 | 1536 | 141 | 39 | 644 | 35.0% | 65.0% | 67 | 129 |
| Home to Days Out | pre | 5946 | 43338 | 4622 | 1198 | 501 | 28.3% | 71.7% | 1692 | 4255 |
| Home to Days Out | post | 4306 | 32185 | 3330 | 891 | 490 | 32.8% | 67.2% | 1408 | 2897 |
| Home to Donate Form | pre | 127 | 826 | 87 | 31 | 601 | 25.5% | 74.5% | 32 | 95 |
| Home to Donate Form | post | 112 | 783 | 75 | 26 | 672 | 25.1% | 74.9% | 27 | 84 |
| Home to Holidays | pre | 901 | 7395 | 649 | 178 | 658 | 24.1% | 76.0% | 218 | 684 |
| Home to Holidays | post | 832 | 6977 | 597 | 168 | 670 | 26.6% | 73.4% | 221 | 611 |
| Home to Join | pre | 2561 | 16271 | 1913 | 600 | 503 | 32.8% | 67.2% | 845 | 1717 |
| Home to Join | post | 2366 | 15870 | 1749 | 556 | 520 | 35.2% | 64.9% | 832 | 1535 |
| Home to Our Cause | pre | 520 | 3631 | 377 | 110 | 608 | 30.7% | 69.3% | 159 | 361 |
| Home to Our Cause | post | 411 | 2909 | 293 | 89 | 617 | 33.4% | 66.6% | 133 | 278 |
| Home to Search Results | pre | 4569 | 29568 | 3401 | 1017 | 487 | 26.0% | 74.0% | 1191 | 3379 |
| Home to Search Results | post | 3156 | 21005 | 2317 | 723 | 489 | 29.1% | 70.9% | 915 | 2241 |
| Home to Shop | pre | 1592 | 13649 | 1232 | 343 | 511 | 30.2% | 69.8% | 486 | 1106 |
| Home to Shop | post | 1395 | 11696 | 1055 | 300 | 510 | 30.3% | 69.7% | 440 | 956 |
| Home to Support | pre | 305 | 2009 | 230 | 64 | 510 | 27.8% | 72.2% | 84 | 221 |
| Home to Support | post | 250 | 1720 | 187 | 52 | 543 | 30.2% | 69.8% | 74 | 176 |
| Homepage Entry | pre | 19355 | 100266 | 15170 | 6207 | 413 | 32.3% | 67.7% | 6257 | 13100 |
| Homepage Entry | post | 14290 | 77733 | 11122 | 4505 | 413 | 35.6% | 64.4% | 5075 | 9216 |
| Join Us Entry | pre | 11387 | 57700 | 9191 | 2781 | 370 | 38.8% | 61.2% | 4428 | 6960 |
| Join Us Entry | post | 10357 | 55056 | 8309 | 2431 | 381 | 42.2% | 57.9% | 4400 | 5957 |
| Members Area Entry | pre | 1062 | 4087 | 904 | 350 | 439 | 17.5% | 82.5% | 273 | 788 |
| Members Area Entry | post | 1703 | 6070 | 1473 | 515 | 429 | 24.2% | 75.8% | 617 | 1086 |
| Property Page Seen | pre | 100862 | 351571 | 87809 | NA | NA | NA | NA | NA | NA |
| Property Page Seen | post | 80125 | 276934 | 69800 | NA | NA | NA | NA | NA | NA |
| Shop Entry | pre | 4849 | 30226 | 3983 | 1369 | 427 | 27.6% | 72.4% | 1529 | 3320 |
| Shop Entry | post | 4379 | 24956 | 3606 | 1205 | 408 | 26.5% | 73.5% | 1543 | 2836 |
Below is the count of anomalies detected for each journey, this is sorted by the number detected in the post launch period. Journeys higher up this list will need more investigation than lower journeys.
| Journey Name | Journey Description | No. of Anomalies (Post Launch) |
|---|---|---|
| Commercial: Shop Checkout Steps 1-4 | Steps 1 to 4 of shop checkout funnel | 67 |
| Commercial: Holidays Checkout Steps 1-4 | Steps 1 to 4 of holidays checkout funnel | 59 |
| Commercial: Renew Checkout Steps 1-3 | Steps 1 to 3 of renew checkout funnel | 49 |
| Commercial: Membership Checkout Steps 1-4 | Steps 1 to 4 of membership checkout funnel | 41 |
| Commercial: Donate Checkout Steps 1-2 | Steps 1 to 2 of donate checkout funnel | 30 |
| Home to Support | Homepage to Support Us (Visitor Level) | 30 |
| Home to Shop | Homepage to Shop (Visitor Level) | 28 |
| Home to Art | Homepage to Art & Collections (Visitor Level) | 27 |
| Days Out to Places Map | Days out to Places Map (Visitor Level) | 25 |
| Home to Days Out | Homepage to Days Out (Visitor Level) | 23 |
| Days Out to Property Page | Days Out to Property Page (Visitor Level) | 21 |
| Days Out to Places Search | Days Out to Places Search (Visitor Level) | 20 |
| Home to Search Results | Homepage to Search Results (Visitor Level) | 20 |
| Home to Join | Homepage to Join Us (Visitor Level) | 19 |
| Join Us Entry | First page of Visit is Join Us (Visitor Level) | 19 |
| Days Out Entry | First page of Visit is Days Out (Visitor Level) | 18 |
| Home to Holidays | Homepage to Holidays (Visitor Level) | 17 |
| Home to Our Cause | Homepage to Our Cause (Visitor Level) | 17 |
| ALL SEO | Visits from Search Engines | 16 |
| ALL Natural Search | Marketing Channel Natural Search Visits | 14 |
| ALL PPC | Marketing Channel Paid Search Visits | 14 |
| Property Page Seen | A property home page was viewed | 14 |
| Homepage Entry | First page of Visit is Homepage (Visitor Level) | 13 |
| Home to Donate Form | Homepage to Donate Form (Button) (Visitor Level) | 12 |
| ALL Tablet | Device Type = Tablet | 11 |
| Members Area Entry | First page of Visit is Members Area (Visitor Level) | 11 |
| ALL Apple iOS | Operating System = Apple iOS | 10 |
| ALL Main Site | Site Section = Main Site | 10 |
| ALL New Visitors | Visit Number = 1 | 10 |
| ALL Repeat Visitors | Visit Number > 1 | 10 |
| ALL Shop | Site Section = Shop | 10 |
| ALL Android | Operating system = Android | 9 |
| ALL Mobile | Device Type = Mobile | 9 |
| ALL Visits | All site visits | 8 |
| Holidays Entry | First page of Visit is Holidays (Visitor Level) | 8 |
| ALL Holidays | Site Section = Holidays | 7 |
| ALL Desktop | Device Type = Other (Desktop) | 6 |
| ALL Email | Marketing Channel Email | 6 |
| ALL Social | Marketing Channel Social Visits | 5 |
| Shop Entry | First page of Visit is Shop (Visitor Level) | 5 |
| ALL Paid Social | Marketing Channel Paid Social | 4 |
| ALL Affiliates | Marketing Channel Affiliate Journey | 3 |
| ALL Direct Traffic | Marketing Channel Direct Traffic Visits | 1 |
Baseline Dates: 2021-09-02 to 2021-11-30. Launch Dated (Red Line): 2021-12-01 to 2022-02-28.
## Forecast processing completed.
Insights:
Membership conversions by Channel. Start: 2022-02-20 to 2022-02-27.
Insights:
Renewals conversions by Channel. Start: 2022-02-20 to 2022-02-27.
Insights:
Insights:
[Min] The lowest amount of Shop - Order Step 4 - Order Confirmation (Serialized) (ev182) was 15, which occurred on Feb. 3rd and was 84% less than the average of 92.
head(mtcars)
## mpg cyl disp hp drat wt qsec vs am gear carb
## Mazda RX4 21.0 6 160 110 3.90 2.620 16.46 0 1 4 4
## Mazda RX4 Wag 21.0 6 160 110 3.90 2.875 17.02 0 1 4 4
## Datsun 710 22.8 4 108 93 3.85 2.320 18.61 1 1 4 1
## Hornet 4 Drive 21.4 6 258 110 3.08 3.215 19.44 1 0 3 1
## Hornet Sportabout 18.7 8 360 175 3.15 3.440 17.02 0 0 3 2
## Valiant 18.1 6 225 105 2.76 3.460 20.22 1 0 3 1
We show the data in this tab.
Start: 2022-02-13 to 2022-02-19.
Last 7 days funnel performance Hover over for fallout details at each stage.
Start: 2022-02-20 to 2022-02-26.
Here is the individual trends for each metric in the shop funnel.
Revenue:
Shop Orders:
Shop - Order Step 4 - Order Confirmation (Serialized) (ev182)
Here is the individual trends for shop sales.
Shop conversions by Channel. Start: 2022-02-20 to 2022-02-27.
Insights:
Donate conversions by Channel. Start: 2022-02-20 to 2022-02-27.